Search results
7 packages found
Floodesh is a distributed web spider/crawler written with Nodejs.
published 0.8.19 4 years ago
M
Q
P
分布式爬虫
published 0.0.72 10 months ago
M
Q
P
a cli tool for floodesh
published 0.4.22 4 years ago
M
Q
P
Aragog web scraping framework client
published 1.0.3 2 years ago
M
Q
P
Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.
- simple
- crawler
- spider
- cache
- queue
- simplecrawler
- eventemitter
- spiderhunt
- distributed
- redis
- rabbitmq
- rabbit
- scalable
published 0.1.2 8 years ago
M
Q
P
Easily build flexible, scalable, and distributed, web crawlers.
published 0.1.20 11 years ago
M
Q
P
Scalable, extensible, web crawler framework.
published 0.0.0 11 years ago
M
Q
P